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ABSTRACT 

Sixth-grade middle sc ool students (N=91) in four 
mathematics classes served as subjects in a study designed to: (1) 
determine if the use of computers as an integral part of instruction 
would increase mathematics achievement; and (2) explore the impact of 
computers as an integral part of instruction on other factors (such 
as student attitudes, attendance, and discipline). Students in 
experimental classes (computer immersion project) spent approximately 
40 minutes of each class period engaged in computer assisted 
instruction while a teacher directed, group centered instructional 
mode was used in control classes. When decisions regarding 
implementation of a new program which is as expensive to replicate as 
the comout^r immersion project must be made, both statistical and 
practical significance must be weighed. Although statistically 
significant differences were found, the practical magnitude of these 
differences was small, and this, coupled with other methodological 
problems, resulted in the conclusion that the computer immersion 
project did not demonstrate an impact of computers, even when time is 
maximized, on any of the variables studied. School district officials 
concurred with this conclusion and the computer immersion model was 
dropped and the computers put to other uses. (JN) 
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2 Computer Immersion 

Ir. examining the impact of computers in the classroom, much o-F 
the enthusiasm -For using this tocl as a learning aide is based on 
reports by principals and teachers that computers produce 
achievement gains and that a child's enthusiasm -For learning is 
increased when computers are used. There have been a large number 
of studies which have empirically investigated these claims. 
Dating back to the early 1970'* s, researchers have provided reviews 
of the effectiveness of Computer Aided Instruction (CAD on 
achievement as well as other factors (Vinsonhaler & Bass, 1974; 
Jamison, Suppes & Wells, 1974", Edwards et al . , 1975). 

Kulik, Bangert and Williams (19S3) applied meta-analysis to 
study the effects of CAI on students in grades 6 - 12. Unlike some 
of the previous reviews, their analysis included only studies in 
which both a CAI and a control class were used. The 51 studies 
included ' :oked at effects in final examination performance, 
attitude toward subject matter, and attitude toward instruction^ 
Results showed increased achievement for CAI in 39 of 43 studies, 
particularly for studies of short duration, more positive attitudes 
toward the subject in S out of 10 studies, and 4 studies which 
reported more favorable attitudes toward instruction. While effect 
on final e;:am performance seemed to be substantial, effect on 
attitudes was somewhat weaker; only 3 of the 10 studies relating to 
attitude toward the subject reported statistically significant 
findings, and none of the attitude toward instruction studies 
reported significant differences. 

In a meta-analysis of the relationship between CAI and 
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3 Computer Immersion 

mathematics achievement, Burns and Bozeman (1981) looked at studies 
in which CAI was used as dr i 1 1 /practi ce or tutorial as a supplement 
and its effect on student achievement. Results indicated that CAI 
was "signi-f icantly more effective in fostering student achievement 
than a program utilising only traditional instructional methods (p. 
37) . " 

Other attempts to summarise the jf-fecti veness o-f CAI have come 
up with general " rul es-o-f-thumb . " Fisher (1983) reviewed articles 
with relation to three -Factors, subject area, achievement range and 
use in the curriculum. He concluded that in terms o-f impact on 
achievement, CAI is most e-f-fective -For science and -Foreign language 
when used with either high or low achievers as a supplement to the 
regular curriculum. It was -Found to be only moderately e-F-Fective 
when used for mathematics and middle achievers. Fisher also 
reported positive changes in student attitude, improved attendance, 
increased motivation, and lengthened attention span. 

For the most part, computers have been used in schools in a 
supplementary capacity, with the number of computers in a school 
limited ?nd the t i me-per-pupi 1 on computer as little as seven to 
ten minutes per day. Additionally, most of the studies which have 
been done to document the effectiveness of CAI have been of short 
duration. kulik (1983) reported that only 18 of 32 studies in 
which the length of the study was given were longer than 8 weeks 
and the Effect Size, the difference between the means of the 
experimental and control group divided by the standard deviation of 
the control group, dropped with duration of the study. 

J I J - f A. \J V V J 
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4 Computer Immer si on 

It is difficult, therefore, to determine the impact of CAI on 
learning and related variables when time orv computer is so small 
and duration of the studies so short* As early as 1970, Grayson 
summed up this methodological problem: "Whil^e many studies have 
been conducted, very few have dealt with large numbers of students 
over a long period of time, even in a loosely controlled situation. 
In many of them, the Hawthorne effect of novelty may be the 
overwhelming factor, (p. 3) " 

The cost of computers is, of course , the reason for this. A 
large urban school district in the southwest reported that its 
ccunputer-to-pupi 1 ratio was 1:235 at the end of the 1932-83 school 
/ear, in spite of an expenditure of 42.5 million for computers that 
same year (HISD, 1983). In 1983-84, this district piloted a 
program designed to study the impact of computers on learning and 
the school environment if provided in quantity, and if the time on 
computer were maximised. 

A middle school mathematics class was equipped with enough 
microcomputers for a 1:1 computer-to-pupil ratio. Two of a sixth 
grade mathematics teacher's classes were designated at random as 
"immersion" classes and two were used as controls. Students were 
M immersed 11 in an environment that would allow each to have access 
to a computer . . The computer was then aval 1 abl e as a maj or support 
system for the teacher, rather than a supplementary device. 

Instruction in the experimental classes was comprised almost 
entirely of time spent on computers. Each student spent 
approximately forty minutes of each class period in CAI. BRA 
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5 Computer Immersion 

software, CDI Mathematics, levels B, C and D were used as core 
material during the pilot time period. The. teacher worked with 
individual students or small groups o-f students when a commjn 
problem was identified. She only worked with the whole class when 
a new conceit was introduced or when a problem a-f-fected a large 
number o-f students. 

In the control classes, a teacher-directed, group-centered 
instructional mode was used. The model was tested at -^he end o-f 
the 1982-So school year, and -Fully implemented during the\entire 
1983-84 school year. 

Evaluation -For this study was designed to: 

1. determine i-F the use o-F computers as an integral part o-F 
instruction would increase mathematics achievement. 

2. explore the impact o-F computers as an integral part o-F 
instruction an other -Factors, such as student attitude, attendance, 
discipline, etc. 



Method 



Sub j ects 

The subjects -For this study consisted o-F 91 sixth grade 
students in -Four mathematics classes at a middle school (grades 6 - 
8) in a large urban school district in the southwest. The classes 
were regular classes, and student 1 were, -For che most part, scoring 
at or just below grade level in mathematics achievement as measured 
by the Iowa Tests o-F Basic Skills. The sample consisted of 46 
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girls and 43 boys, with an equal representation of boys and girls 
in both the- experimental and control groups. The school was 
ethnically mixed, with a predominantly Hispanic population. 

Procedure 

The mathematics classroom was equipped with 26 Apple II 
computers, enough to provide a l:i computer-to-pupil ratio. From 
the beginning o-f the scnool year until the administration o-f the 
Iowa tests o-f Basic Skills in early March, two classes used the 
computers as the primary means o-f instruction. These classes were 
selected at random -From six classes being taught by the mathematics 
teacher who participated in the study. Two o-f her other classes 
were designated as control classes. There were 50 students in the 
two exper ijnental classes and 41 students comprised the two control 

si 

groups. 

Instruction in the experimental classes consisted almost 
entirely o-f time spent on computers. Each student spent 
approximately forty minutes o-f each class period at a computer. 
The SRA software, CDI Math, Levels 8, C and D, were used as core 
material. This material provided drill and practice as well as 
tutorial for tne students. 

Additional mathematics software was also utilized as 
supplementary material. SRA core materials were used 30-35 minutes 
each class period. Other materials, such as the DLM software were 
generally used for 5 to 10 minutes at the end of each class period 
fcr s\ ill building and as a motivator. 
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Insert Table 1 about here. 



The teacher worked with individual students or small groups 
when a common problem was identified. only worked with the 

whole class when a new concept was it a uced or when a problem 
affected a large number of students. In the control classes, a 

teacher -di rec ted ., group -cantered i n struct i on a J mode was used. 

The only computer literacy provided to the student was that 
which was necessary to operate the software. Two days were spent 
an terminology and explaining how to use the diskettes. 

During the time period in which the study took place a series 
of observational visits to the campus took place. Both 
experimental and control classes were visited. Classroom patterns 
were noted as was student ti me-on-task . The teacher was interview 
at the end of the school year. Data relating to the implementation 
of the program, problems encountered and general impressions of the 
experience were gathered. 

Student dat * collected at the end of the school year included: 
1984 raw scores for the Mathematics Skills subtest of the Iowa 
Tests of Basic Skills, Concepts, Computation and Problem Solving, 
number of days absent from school, number of times tardy to math 
class, number of discipline cards filed on each student, and scores 
on two measures of attitudes toward mathematics, Attitudes Toward 
Arithmetic (Dutton & Blum, 1986) and the Fennema-Sher man 
Mathematics Attitudes Teacher Scale (Fennema & Sherman, 1976) . 
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Inst rumen tat i on 

A measurement of achievement already in use by the district 

during 1983-84 was used. The Iowa Tests o-f Basic Skills, Level 12, 

/ 

Test M (Mathematics Skills) which comprised the regular testing 
program was utilised. This test yields scores -For mathematics 
computation, concepts and problem solving. Raw score data were 
obtai ned . 

Attitudes Toward Arithmetic 

The Attitudes Toward Arithmetic scale (ATA) was developed in 
1968 by Dutton and Blum (1968). It. is a 25 item Li kert-type scale 
designed to assess student's attitudes toward arithmetic. This 
scale was constructed by putting the strongest items from a 
previously constructed Thur stone-type scale into a Likert -Format. 
Half of the items were positive and half negative in connotation. 
Calculate: i Spearman-Brown test-retest reliability was 0.84. 
E§QQgm a -Sherman Mathematics Attitudes Teacher Seal e 

The Mathematics Attitudes Teacher Scale (MATS) was "designed 
to measure students 1 perceptions of their teacher's attitudes 
toward them as learners of mathematics. It includes the teacher's 
interest, encouragement and confidence in the student's ability 
(Fennema 8< Sherman, i976, p. 4)." 

The scale consists of six positively stated and six negatively 
stated Li k art-type items with five response alternatives: strongly 
agree, agree, undecided, disagree, strongly disagree. The person's 
score on the scale is the cumulative total; the higher the score, 
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the more positive the attitude. Split-half reliabilities were 
reported to be 0.38. A -Factor analytic technique was uti lined to 
provide evidence of construct validity. 
Data Analysis 

Because the major focus of the evaluation was to document 
increased levels of achievement in the computer immersion classes, 
an analysis of covariance was done, using the 1983 mathematics raw 
score total from the ITBS as a covariate and th= 1984 mathematics 
rsw score total as a dependent variable. To explore the 
relationship of CAI to other factors, a two-group stepwise 
discriminant analysis was also conducted, using Wilks lambda *s a 
selection criteria (Hair et al . , 1979). Scores on both math 
attitude scales, the ATA and the MATS, number of times tardy to 
math class, number of days absent, number of discipline cards on 
file, and scores on each of the three mathematics subtests, 
computation, concepts and problem solving for each student were 
used as predictor variables. Because the sample s\ze was not large 
enough to exclude some cases from the analysis, the rii scr i mi nant 
function was calculated using all cases. The Statistical Package 
for the Social Sciences was used for all data analysis. 

Resul ts 

The analysis of covariance yielded a significant main effect 
for group between the computer immersion students and the control 
group . 
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Insert Table 2 about: here. 



A significant di scriminant function was found consisting of a 
reduced set of three variables, number of times tardy to math 
class, number of discipline cards filed and mathematics computation 
raw score- The canonical correlation squared, a measure of the 
proportion of variation in the discriminant function explained by 
the groups (Kl.ecka, 3.980) was . Box's M was significant- 



Insert Tables 3 & 4 about here. 



Classification of cases resulted in 63.137. of the cases 
correctly classified. A higher proportion of the computer group 
was correctly classified. 



Insert Table 5 about here. 



Di scussi on 

The eval uati on desi gn empi oyed in the computer i mmersi on 
project had two foci: to determine if the project had an impact on 
students' mathematics achievement and to explore the project's 
effect on other variables. The raw score mathematics totals for 
the computer group and the control group yielded statistically 
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significant differences. The discriminant analysis indentified the 
part o-F that overall score which was contributing to group 
di-f-f erences to be computation scores. When the magnitude of these 
differences was examined, however, it was -found that the mean raw 
score total/ -for the computer immersion group differed from the 
control group by just over one item. 



Insert Table 6 about here. 



The discriminant analysis resulted in a reduced set of 
variables which comprised the function. The number of times tardy 
to mathematics class, number of discipline cards filed and the 
mathematics computation raw score significantly differentiated 
between the groups. Wilks lambda values for the three variables 
were high, however (Table 4). Wilks lambda is an inverse measure 
'Klecka, 1980). As lambda increases, there is less discrimination 
between the groups. Lambda values such as those obtained indicate 
low discrimination in spite of statistical significance. The 
canonical correlation squared indicated that less than 15"/. (x4.8V.) 
of the variance was accounted for by the groups. 

An additional problem with the discriminant analysis > ..s a 
significant Box's M. One of the assumptions of discriminant 
analysis is equality of the group covariance matrices, and this 
uata violates that assumption. While some authors consider 
discriminant analysis to be a robust technique with respect to 
these violations (Lachenbruch, 1975), the amount of error this has 
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12 Computer Immersion 

introduced is unknown- 
Interpretation of the data from this study, then, becomes very 
much a question of practical significance rather than statistical 
significance. The mean difference between the math computation raw 
scores for the two groups was less than two items (1-9). 
Similarly, a difference of only one time tardy to math class was 
found between the two groups and no difference was found in the? 
avereage number of discipline cards filed- The fact that this 
variable was included in the discriminant function was accounted 
for by the fact that one student in the control group was 
responsible for ^6 discipline cards. 

When decisions regarding the implementation of a new program 
which is as expensive to replicate as the computer immersion 
project must be made,, hot . statistical and practical significance 
must be weighed. The e\ iation of the computer immersion project 
did yield statistically significant differences. The practical 
magnitude of these differences was small, however, and this, 
coupled with other methodological problems, resulted in the 
conclusion that the computer immersion project did i at demonstrate 
an impact of computers even when time is maximised on any of the 
variables studied. School district officials concurred with this 
concl usi on. The computer l mmersi on mod^l was dropped and thf? 
computers were put to other uses- 



13 



13 



Computer Immersion 



Ref erences 



Burns, P.K. & Baseman, W.C. (1981). Computer-assisted instruction 

and matnematics achievement.: Is there a relationship? 
Educational Technology. , 21 (10), 32-39. 
Dutton, W.H. & Blum, M.P. (1968). The measurement of attitudes 

toward arithmetic with a Likert-type test. The Elementary 

School. Journal , 68 (2), 259-264. 
tZdwards, J., Norton, S. , Taylor, 5. , Weiss, M. , St Duseldorp, R. 

(1975). How e-f-fective is CAI? A review of the literature. 
Educational, Leadership , 33 , 147-153. 
Fennema, E. & Sherman, J. A. (1976). Fennema-Sher man mathematics 

attitudes scales: Instruments designed to measure attitudes 

toward the learning of mathematics by males and females. 
Psych gl.ggi.cal_ Documents , 6 (1). (Ms. No. 1225) 
Fisher, G. (1983). Where CAI is effective: A summary of the 

research. Electronic Learning , 3 , (3) , 82-84. 
Grayson, L.P. (1970). A paradox : The promises and pitfalls of 

CAI. EDL^QM Bulletin , 1-3. 
Hair, J.F., Anderson, R.E., Tatham, R.L., & Grablowsky, B.J. 

(1979). Multivariate data analysis . Tulsa, 0K:F-PC Books. 
Houston Independent School District (1983). Computer supported 

immersion school project: Concept paper. Unpublished 

manuscript, Houston Independent School District, Houston, 

TX. 




copy 



14 



14 



Computer Immersion 



Jamison, D. , Suppes, P. & Wells, S. (1974). The effectiveness 

of alternative instructional media: A survey. Review of 

EdUQifelQnal Research , 44 1-61. 
Klecka, W.R. (1980). Di scr i mi.naQt analysis . Beverly Hills, 

CA: Sage Publications, Inc. 
Kulik, J. A., Bangert, R.L. Z< Williams, S.W. (1983). Effects of 

computer-based teaching on secondary school students. 
Journal, of Educational Psychology. , 75 (1), 19-26. 
Lachenbruch, P. A. (1975). Discriminant analysis , New York: 

Haf ner . 

Vinsonhaler, J.R. & Bass, R.K. (1972). A summary of ten major 
studies on CAI drill and practice. Educational. Iechngl_ogyj. 



15 



15 



Computer Immersion 



Table 1 




Sufifilsment 


Software 


Pub 1 i sher 


Title 


MECC 


Volumes 8, 9, 10 (Geometry) 




Lemonade 


DLM 


Dragon Mix 




Demol i t i on Di vi si on 




Meteor Mul t i Dl i cati on 


SRA 


Est i mat i on Tenni s 




Beano 




Ti me Mul t i pi i cat i on. Test 


"~ARS Test 


Fifth Grade Level 




Addi tion , Subtraction, 




Mul tiplication, Division, 




Linear & Solid Geometry, 




Identification of Polygons, 




Place Value 


Teacher 


"Pink Panther" (Li near 


Devel oped 


Geometry Terms) 




Review Program 
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Table 2 

Analysis of Coyariancgi 1984 ITBS Math Ski lis Igtal Raw Score 

Source Adjusted Adjusted F 

df MS 



Between Groups 1 43.184 5.357* 

Within S3 8.061 

Total 84 



*p< . 05 
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Wi Iks- 1 
Lambda 



d-f 



.8516 



13.735* 
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Table 3 

Canonical, Discriminant Function 



Ei genval ue 



Canoni cal 
Correl ati on 



0. 1743 



0. 3852 



*p > . 0 1 
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Table 4 

Standardized Discriminant Function Coefficients and Wilksl Lambda 
fQC Reduced Set of Variables 

Variable Standardised Wilks 7 Lambda 

Coefficients 



Tardies -1.1371 0.9523 

Discipline Cards 0.9707 0.8687 

Computation Raw Score 0.3659 0.8516 
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Table 5 



Classification Results 



N 



Actual Group 



Computer 



Control 



50 



41 



Predicted Group Membership 



Computer 



Control 



42 
84. 07. 

21 
51-27. 



8 

16. 07. 

20 
48.87. 



Percent of Cases Correctly Classified: 68.137. 
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Table 6 

Groyp_ Means and Mean Differ encgSj. All Variabl.es 



Computer Control Di-f-ference Overall 





N=48 




N=40 




N=88 


ATA 


SB. 3 




86.8 


1 . 5 


87. 6 


MATS 


43. 9 




43.9 


0.0 


43. 9 


Days Absent 


5.7 




6.8 


1 . 1 


6. 2 


Tard i es 


.6 




1.6 


1.0 


1 . 0 


Disc. Cards 


.6 




.6 


0 . 0 


. 6 


Math Total 


67. 9 




66.6 


1.3 


67. 4 


Computati on 


30. 9 




29. U 


1.9 


30 . 0 


Concepts 


22. 9 




21.6 


1.3 




Prob. Solving 


16. 1 




15.8 


0 . 3 


16. u 
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